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We propose a soft-output detection scheme for Multiple-Input-Multiple-Output 
(MIMO) systems. The detector employs Markov Chain Monte Carlo method to 
compute bit reliabilities from the signals received and is thus suited for coded MIMO 
systems. It offers a good trade-off between achievable performance and algorithmic 
complexity. 



I. INTRODUCTION 



Multiple-Input-Multiple-Output (MIMO) systems improve the channel capacity many- 
bid by the use of multiple antennas at transmitter and at receiver It was shown 
l| that the channel capacity increases linearly with the number of transmit antennas in a 
rich scattering environment. Because of this it has become possible to design transmission 
schemes where a single data stream is split into several substreams that are simultaneously 
transmitted to the available transmit antennas. MIMO forms the core technology for the 
next generation wireless networks, as seen in the standards IEEE 802.1 In (wireless LAN) 
as well as IEEE 802. 16e (wireless MAN). 

The optimal MIMO receiver distinguishes the spatial signatures of different transmit 
substreams as seen at the receiver, while fully exploiting available receive diversity. The 
detection process also accounts for the structure of symbol constellations. The latter feature 
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implies that a Maximum a Posterior (MAP) receiver is inherently more robust (in terms of 
error rates) to low-rank channels, as noted in 3|. However, the implementation of an exact 
MAP detector requires testing of all possible hypotheses in order to compute the reliability 
of each bit, the number of hypotheses being exponential in the number of transmit antennas 
and the number of bits. There has therefore been extensive work both in reducing the 
co.puta«on., .o.p.ex.. of op..a, o. nea.op..a, detect. QflB and . dev..,, .b- 
optimal approaches to MIMO detection. Some of the latter include a space-time DFE with 



hard 



3] and soft cancellation 



and the use of iterative receivers jo], 1^. The major drawback 
of all the sphere decoding algorithms and their variants is their worst case complexity (which 
is exponential) and the problems encountered in computing soft values. 

Markov Chain Monte Carlo (MCMC) methods essentially consist of drawing samples 
from a desired probability distribution. Multidimensional systems (such as MIMO) are 
specially suited for MCMC methods, whose complexity is at most polynomial with respect 
to signal dimensions. In a recent paper, Guo and Wang HI] proposed detection methods for 
MIMO systems based on sequential Monte Carlo (SMC) method. Dong, Wang and Doucet 
121 1 applied the same method to a BLAST-type receiver and demonstrated that this can 

n 

significantly improve the performance of MIMO detectors. Recently, Berouzhny et al [13| 
have reported improved performance using a Gibbs sampler. In this paper, we develop a 
Soft-In-Soft-Out (SISO) MIMO detector using an MCMC algorithm on a multidimensional 
lattice. 



II. PROBLEM FORMULATION 

Consider a MIMO system with transmit and receive antennas, see Fig. (1). The source 
bits are encoded and then interleaved before being mapped to M symbol streams for trans- 
mission. Each symbol stream contains symbols drawn from the constellation . For a fiat- 
fading channel if, the received signal y is given by 

y = Hs + n (1) 

where n is the circularly symmetric channel additive Gaussian white noise vector, with 
independent components each with the same variance a^. For the k}'^ bit of the m*^ symbol 
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FIG. 1: MIMO system with transmit and receive antennas 

Sm, denoted as 6^,/^ the MAP detector computes its L*^ -value given by 

'p{bm,k = i|y)\ 



■'m,k 



log 



,'pipm,k = 0|y) 



(2) 



III. MARKOV CHAIN MONTE CARLO METHODS 



Markov Chain Monte Carlo (MCMC) methods are a family of statistical simulation algo- 
rithms that help construct an ensemle of realizations or states from the desired multivariate 
probability distribution. In a typical MCMC method we start from an arbitrry state and 
construct a Makov chain whose asymptotic part contains states that belong to the desired 
distribution. This is ensured by suitably constructing a Markov transition matrix so that 
its stationary distribution coincides with the desired distribution. With easy availability of 
high performance computing machines in recent times this method has become popular and 
is being increasingly employed in a variety of fields that include physics, chemistry, biology. 



economics and engineering see e.g. 



In this paper, we use MCMC method to solve a Bayesian inference problem. To this end, 
we identify the desired probability distribution (say p{x) of the random variable x) over which 
the inference is to be made. All possible discrete values that x can take, constitute the state 
space. We construct a Markov chain of states. The transition probability of the Markov 
chain determines the trajectory of the Markov Chain in the state space. Asymptoticlly the 
Markov chin converges to the desired disribution. The effectiveness of MCMC metod relies 
on the following: 

a. the Markov Chain quickly reaches its stationary distribution and 

b. the desired inference parameter usually depends only on the most probable values 
of the random variable, that is, those states that are most frequently visited by the 
Markov Chain. 
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Thus, spanning the entire state space that is usually exponential with the size of x is not 
necessary to extract useful information about the distribution. 



IV. THE METROPOLIS ALGORITHM 

The Metropolis algorithm jlS] draws samples from a probability distribution p{x), referred 
to as the target distribution in this paper. The idea behind this algorithm is to construct 
a Markov chain whose stationary distribution matches with the target distribution. Given 
the current state x a Metropolis sampler draws a candidate state, also called trial state Xf. 
The next state in the Markov chain can be either x itself or the trial state Xt- The choice is 
made randomly by drawing random numbers. To this end we define a Metropolis acceptance 
probabiity given hj p = mm{l, p{x) / p{xt)) . If the random number drawn is less than p the 
trial state is accepted as the next entry in the Markov chain. Otherwise the current state 
continues and forms the next state. The transition probability matrix Q defined by the 
Metropolis algorithm, satisfies detailed balance condition, given by 

p{xi)Q{xj\xi) = p{xj)Q{xi\xj) V i,j (3) 

Note that the knowledge of the trget distribution is required only upto a normalization con- 
stant, which makes this algorithm very useful for simulating equilibrium statistical physics 
systems where the normalizing partition function is not known. 

V. BIT RELIABILITY ESTIMATION USING MCMC 

The posterior probability that bm,k = 1 is givn by 

p{bm,k = l|y) = PiSm,k\y) (4) 



(1) 



Here Sj^^ denotes all the symbols from the constellation S that have 1 in their k^^ bit 
position. Expressing H] as the marginalized probability over all other symbols 

Q(—m) rc C C C 1 

O — [Do Oi ■ • • Om+1 ' ' "J 

and applying Bayes theorem with prior symbol distribution 
Pib^,k = l\y)= E E M5„.,S(-'")|y) 
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sinificant terms 



The final expression in the above is obtained assuming the sum is dominated by those symbol 
vectors that are most probable. The number of these terms will be denoted by A^^. Eq. ([5]) 
can be interpreted as a Monte Carlo integral, see [l3|. A similar expression can be derived 
ioT p{bm,k = 0|y). 

VI. A RANDOM WALK METROPOLIS ALGORITHM ON A SYMBOL 

LATTICE 

The L- values may thus be computed by a search over the symbol lattice. In a recent 
paper [l^, a uniform Gibbs sampler is used to perform the search. The algorithm may be 
improved by confining the search to those lattice points that are more probable. This is 
captured by the likelihood p(y|S) that can be sampled using a Metropolis algorithm. 

Consider a random walk Metropolis sampler that has the target distribution p(y|S). 
Observing that each vector S has a total of AM neighbors (see Fig. 2), 
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FIG. 2: Example of a nearest neighbour jump 
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if S' is a neighbour of S 
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Q(S'|S) = < 



(6) 







otherwise 



A periodic boundary condition is apphed at the lattice edges. At each iteration step, a trial 
state is randomly chosen amongst the nearest neighbors of S, and is accepted as the next 
state with the Metropohs acceptance probabihty 



We now present some simulation results on a 3 x 3 MIMO system, i.e., with 3 transmit 
and 3 receive antennas. A packet of 64 bj^es was encoded using a rate-1/2 convolutional 
code with the generator matrix G = [133, 171] (in octal notation). After interleaving, the 
bits are mapped to a (gray-coded) 16-QAM constellation. The MIMO channel is assumed 
to be i.i.d. Rayleigh fading, and changes with every channel use. At the receiver, the perfect 
CSI is assumed and the Metropohs sampler estimates the bit rehabilities (LLRs) using the 
Random Walk Metropohs Algorithm (RWMA) described above. The key parameters that 
determines the detector complexity is the number of Metropolis iterations (denoted by R) , 
and the number of significant terms used (denoted by A^^). In all the simulations, we have 
set Ng = 1, that corresponds to the max- log- MAP approximation. We have also compared 
the results with uniform sampling. As the results in Figure 3 show, the frame error rate 
with the proposed algorithm is superior to that of uniform sampling, and seems to improve 
when R is increased. 

The efficiency of a Metropohs sampler depends critically on its ability to efficiently span 
the sample space. This is captured in the acceptance ratio, which is defined as the number of 
number of actual state changes to the total number of Metropolis attempts. Efficient sam- 
plers have acceptance ratios between 0.4 to 0.7. The argument of the exponential function 
of the prior distribution is sclaled by a constant referred to in statistical physics literature as 
temperature. In several problems, the Metropolis algorithm can be improved by increasing 
the temperature. In the present case, noise plays the role of temperature in the system. 




VII. SIMULATION RESULTS 
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FIG. 3: Simulation of RWMA algorithm on a 3x3 16-QAM system 

Increasing the temperature improves the sample space coverage. In our simulations, the 
sampling temperature was set to be 10 times that of the ambient noise. 

VIII. CONCLUSIONS 



We have proposed a soft output MIMO detector employing a random walk Metropolis 
algorithm. We find that this method provides a good tradeoff between computational com- 
plexity and soft output reliability. Some interesting possibilities are the inclusion of a prior 
in the detection process and reducing the complexity of each Metropolis step. These are 
currently being investigated. 
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